We review recent results on the appearance of long-term persistence in climatic records and their relevance for the evaluation of global climate models and rare events.The persistence can be characterized, for example, by the correlation C(s) of temperature variations separated by s days.We show that, contrary to previous expectations, C(s) decays for large s as a power law, C(s) ~ s^(-gamma). For continental stations, the exponent gamma is always close to 0.7, while for stations on islands gamma is around 0.4. In contrast to the temperature fluctuations, the fluctuations of the rainfall usually cannot be characterized by long-term power-law correlations but rather by pronounced short-term correlations. The universal persistence law for the temperature fluctuations on continental stations represents an ideal (and uncomfortable) test-bed for the state of-the-art global climate models and allows us to evaluate their performance. In addition, the presence of long-term correlations leads to a novel approach for evaluating the statistics of rare events.